Papers by Jason E Weston
Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge (2025.emnlp-main)
Copied to clipboard
Tianhao Wu, Weizhe Yuan, Olga Golovneva, Jing Xu, Yuandong Tian, Jiantao Jiao, Jason E Weston, Sainbayar Sukhbaatar
| Challenge: | Existing methods for improving large language models have focused on improving model responses rather than judgment capabilities, resulting in rapid saturation during iterative training. |
| Approach: | They propose an iterative Meta-Rewarding step where the model judges its own judgements and uses that feedback to refine its judgment skills. |
| Outcome: | The proposed model improves Llama-3-8B-Instruct from 22.9% to 39.4% on AlpacaEval 2 and 20.6% to 29.1% on Arena-Hard. |
Following Length Constraints in Instructions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing instruction following models fail to follow length constraints in their evaluations. |
| Approach: | They propose to train models that can be controlled at inference time with instructions containing desired length constraints. |
| Outcome: | The proposed models outperform standard instruction following models in length instructed evaluations. |
Byte Latent Transformer: Patches Scale Better Than Tokens (2025.acl-long)
Copied to clipboard
Artidoro Pagnoni, Ramakanth Pasunuru, Pedro Rodriguez, John Nguyen, Benjamin Muller, Margaret Li, Chunting Zhou, Lili Yu, Jason E Weston, Luke Zettlemoyer, Gargi Ghosh, Mike Lewis, Ari Holtzman, Srini Iyer
| Challenge: | Existing large language models (LLMs) are trained on bytes, except for tokenization, which groups bytes into a static set of tokens. |
| Approach: | They propose a new byte-level LLM architecture that encodes bytes into dynamically sized patches, which serve as the primary units of computation. |
| Outcome: | The proposed architecture matches tokenization-based models with improvements in inference efficiency and robustness. |